r 


James  S.  Demetry 

OPTIMIZING  FOR  MINIMUM  RESPONSE  TIME  IN 
A  LINEAR  SYSTEM  WITH  LIMITED  CONTROL  EFFORT, 


TA7 
.U6 
no. 45 


fcibrary 

U.  S.  Naval  Postgraduata  8e*O0' 

Monterey,  Caliiornia 


UNITED  STATES 
NAVAL  POSTGRADUATE  SCHOOL 


OPTIMIZING  FOR  MINIMUM  RESPONSE  TIME 
IN  A  LINEAR  SYSTEM 
WITH  LIMITED  CONTROL  EFFORT 

By 

James  S.  Demetry 
Harold  A.  Titus 


RESEARCH  PAPER  NO.  45 
April  1964 


OPTIMIZING  FOR  MINIMUM  RESPONSE  TIME  IN  A  LINEAR  SYSTEM 
WITH  LIMITED  CONTROL  EFFORT 


By 

James  So  Demetry 
Harold  A.  Titus 


Eibrary 

V.  S.  Naval  Postgraduate  Sctoflf 

Monterey,  California 

ABSTRACT 


Integral  indices  of  performance  are  brought  to  bear  on  the 
problem  of  minimizing  step  response  time  in  some  simple  control 
systems.  This  minimization  is  subject  to  a  bound  on  the  total 
control  effort  that  may  be  expended  in  response  to  a  step  command, 

Special  attention  is  given  to  an  index  whose  integrand  is  a 
form  of  the  Euclidean  norm  of  the  system's  states .  An  example  is 
given  showing,  for  a  given  system,  the  development  of  a  weighting 
scheme  for  the  second  term  in  a  two- term  index  of  performance. 


I   Introduction 

This  paper  deals  with  the  use  of  performance  indices  (integral 
cost  functions)  in  the  design  of  control  systems  that  are  to  satisfy 
certain  time-domain  requirements  and  limitations.  The  optimum  de- 
sign, i.e.,  minimum  index  value,  is  not  an  end  in  itself,  but  a  means 
of  obtaining  the  desired  response  characteristics  with  economy  of 
calculation. 


II   The  Optimization  Problem 

The  optimum  design  of  linear,  continuous  feedback  control  systems 
usually  implies  optimization  with  respect  to  some  pre-selected  index 
of  performance  (I  P),  or  cost  function.   Such  indices  of  performance 
normally  take  the  form  of  integrals  of  various  functions  of  time 
(t),  and  error  (e).  Optimization  is  possible  because  the  indices 
generally  exhibit  minima  as  functions  of  a  selected  system  parameter. 

As  an  example  of  such  an  optimum  design,  consider  the  system  of 
Figure  1,  a  second-order,  type  1  position  control  system.  The  value 
of  K  is  fixed,  and  the  tachometer  gain  a  is  to  be  selected  to  mini- 
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mize  the  index  IP  =1  e  dt  in  response  to  an  input  B.   =  Ru(t).  By 
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integral  tables  developed  from  Parseval's  theorem, 
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Minimizing  the  IP  with  respect  to  a, 
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we  obtain 


a  =  7T  <3) 

Using  the  tachometer  gain  given  by  (3)  yields,  then,  a  system  that 
is  optimum  with  respect  to  the  integral  of  square  error  as  an  index 
of  performance.  Note  the  familiar  result  that  the  damping  ratio, 
C,  is  0.5. 


It  should  be  noted  that  no  practical  solution  exists  for  the 
problem  above  if  it  posed  so  that  we  seek  an  optimum  value  of  K  for 
a  given  a.  The  solution  demands  that  K  be  infinite  for  minimum  IP. 

Two  questions  might  logically  be  asked  about  the  analytic  de- 
sign procedure  carried  out  in  the  preceeding  example . 

a)  Is  the  minimization  of  the  performance  index  an  end  in  it- 
self, or  is  it  a  means  whereby  acceptable  figures  for  other, 
more  familiar  and  perhaps  more  meaningful  measures  of  system 
performance  are  more  or  less  automatically  arrived  at? 

b)  Will  the  design  that  results  from  such  an  optimization  always 
be  realizable  in  the  sense  that  it  does  not  exceed  certain 
energy  or  equipment  limitations? 

Ill   A  Constraint  on  Total  Control  Effort 

Question  b)  will  be  dealt  with  first..  The  particular  type  of 
physical  limitation  to  be  considered  is  the  constraint  of  an  upper 
bound  on  the  integral  square  value  of  an  appropriate  quantity  within 
the  system.  Such  a  constraint  may  realistically  be  interpreted  in 
terms  of  the  total  energy  expended  in  driving  the  system  in  response  , 
to  a  given  input,  or  perhaps  in  terms  of  the  heating  effect  ex- 
perienced by  a  component  in  the  system.  By  way  of  example s  the  ampli- 
fier output  denoted  by  u  in  figure  1  will  be  constrained  by  the  in- 
tegral form 

r    2  a 

u     dtay  =  total  control  effort  (4) 

Jo 


The  equality  sign  is  intended,  rather  than  <  ,  since  we  wish  the  sys- 
tem to  operate  at  the  bound.  Integral  tables  yield,  for  8.  -  Ru(t), 
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(5) 
o 

The  immediate  result  of  the  constraint  is  an  expression  which  shows 
the  possible  and  allowable  combinations  of  amplifier  gain  K  and  tachom- 
eter gain  a;  namely, 
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IV   Optimization  Subject  to  the  Constraint 

Let  us  now  return  to  the  problem  of  the  optimum  design  for  the 
system  of  Figure  L  The  minimization  of  the  IP  may  now  be  carried  out 
with  respect  to  either  parameter,  K  or  a.  Note  that  it  is  not  necessary 
to  pre-specify  either  of  the  two  gains,  since  their  values  are  now  re- 
lated by  equation  (6) .  This  lends  a  certain  measure  of  uniqueness  to 
the  design.   Substituting  equation  (6)  into  equation  (1)  gives 

k  r rfy 

Minimizing  with  respect  to  K; 

dK        tr      4ez 

which  yields 

2/3 
K  ■  2E  (9) 

Calculating  the  damping  ratio  for  the  optimum  System,  we  find 


2CW  -  Ka  (10) 

n 

giving 

c  a  ^rs  ^  k3/2 = ^  cn) 

Once  y,  the  total  allowable  control  effort,  is  chosen,  the  optimum 
design  follows  from  equations  (6)  and  (9) .  The  design  may  be  said  to 
be  optimum  with  respect  to  integral  square  error,  subject  to  the  con- 
straint on  total  control  effort.  That  is,  choosing  a  different  (non- 
optimum)  set  of  values  for  K  and  a  might  result  in  a  smaller  integral 

square  error,  but  the  upper  bound  on   u  dt  will  as  a  result  be  violated, 

o 
Note,  also,  that  the  optimum  design  has  a  damping  ratio  of  0-707,  in- 
dependent of  y   or  R. 

Introduction  of  the  constraint  has  not  only  acknowledged  a  physi- 
cal limitation  of  the  plant,  but  has  as  well  allowed  for  the  simultaneous 
solution  for  two  optimum  parameters  within  the  system. 
V   A  Generalized  Performance  Index 

Answers  to  question  a)  have  been  the  subject  of  many  technical 

1  2 
papers  * s  Gibson  says  of  integral  square  error  as  an  index  of  perform- 
ance, "has  poor  selectivity.   Optimum  systems  tend  to  be  underdamped. 
Used  mainly  because  of  mathematical  convenience."  It  is  for  this 
mathematical  convenience  that  a  generalization  of  the  ISE  will  be 
considered.  The  integral  square  of  the  Euclidean  norm  of  a  system" s 
states  is  proposed  as  an  index  of  performance.  This  index  will  be 
used  to  synthesize  minimum-time  or  quasi-minimum-time  linear  control 
in  systems  where  two  parameters  are  variable.  The  two  parameters  are 

Gibson  et  al,  App.  and  Ind.,  May,  1961. 

2 
Graham  and  Lathrop,  App.  and  Ind.,  Nov.,  1953. 


to  be  made  functionally  dependent  by  an  integral  square  constraint  on 
the  signal  driving  the  plant .  The  minimum  time  description  and  the  in- 
tegral square  constraint  shall  apply  for  the  case  in  which  the  largest 
anticipated  step  input  is  applied  to  the  system..  We  seek  am  algorithm 
for  the  selection  of  the  literal  coefficients  in  the  generalized  index 
of  performance 

00 

IP  -  J   [x*  +  ax*  +  bx*  +  .  o .]  dt  (12) 

o 

such  that  response  time  is  minimized .  The  coefficients  may  be  functions 

of  R,  y   and  the  plant's  fixed  parameters  %   the  x  are  the  state  variables . 
VI   Definition  of  Response  Time 

For  purposes  of  this  paper,  response  time  is  given  a  definition  in 
terms  of  state  variables,  as  follows?  Tr  is  the  time  required  for  the 
state  point  to  move  from  its  initial  value  x(0)  to  within  a  certain 
distance  from  its  desired  final  value,  x(F).  The  state  variables  may 
or  may  not  be  normalized  in  determining  the  distance  from  the  final  state . 

To  illustrate  this  definition  of  response  time,  let  us  refer  to  Fig- 
ure 1  and  note  the  manner  in  which  the  state  variables  x..  and  x2  are  de- 
fined o  The  state  trajectory  of  this  system  in  response  to  an  input 
9  =  Ru(t)  is  shown  on  the  phase  plane,  Figure  2»  The  response  time  is 
the  time  required  for  the  magnitude  of  the  vector  D  to  decrease  from  its 
initial  value  R,  to  the  value  p,  where  p  is  an  arbitrary  constant  value » 
It  is  desirable  to  have  the  state  point  remain  within  this  target  circle 
of  radius  p  once  it  has  entered,  lest  the  ambiguity  of  multiple  crossings 
of  the  target  circle  be  introduced .  It  is  for  this  reason  that  the  velocity 

state  is  best  normalized  to  x_/tO  .  where  CO  is  the  undamped  natural  fre- 

2  n        n  r 

quency  of  the  system.,  It  may  be  shown  that  such  a  normalization  insures 
a  single  crossing  of  the  target  circle  for  any  second-order  system 
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responding  to  a  step  input. 

High-accuracy  (digital  computer)  response  time  information  for 
the  system  of  Figure  1  is  presented  in  Figure  3.  The  constraint  on 
total  control  effort  is  as  given  in  equations  (5)  and  (6)s  withy 
arbitrarily  chosen  as  1.0.  The  independent  variable  is  forward  gain  K, 
to  each  value  of  which  there  corresponds  a  unique  value  of  a  by  con- 
straint equation  (6) .  Plotted  against  K  is  the  response  time  to  several 
target  circles  on  the  velocity-normalized  phase  plane ,  where  the  radii 
of  the  respective  circles  are  expressed  as  percentages  of  the  step  in- 
put magnitude,  R.  For  each  of  the  response  time  curves  there  is  a 
setting  for  K  (and  hence  for  a)  which  minimizes  that  curve;  that  setting 
may  be  said  to  be  the  optimum  setting  with  respect  to  response  time  to 
that  particular  target  circle.  It  is  observed  that  as  the  target  circle 
shrinks ,  response  time  goes  to  infinity ,  with  the  minimum  on  the  curve 
moving  upward  and  to  the  right,  asymptotic  to  a  vertical  line  through 
K  =  2.5.  In  an  absolute  sense,  then,  this  system  is  optimized,  with 
respect  to  response  time  to  an  infinitesimal  target  circle,  by  a  gain 
setting  of  K  -  2.5  and  the  corresponding  tachometer  setting  of  a  =  1.25. 

The  information  in  Figure  3  was,  as  previously  noted 9   obtained 
by  calculation.  Could  the  same  conclusions  as  to  the  optimum  response 
time  design  have  been  reached  by  optimizing  the  system  with  respect 
to  some  mathematically  workable  index  of  performance?  This,  of  course, 
is  question  a)  rephrased,  and  applied  to  this  example.  The  answer  to 
it  is  yes,  if  there  exists  an  index  of  performance  which,  when  plotted 
on  Figure  3  with  its  value  versus  K,  exhibits  a  minimum  coincident 
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or  near  coincident  with  the  optimum  K  for  minimum  response  time  in  the 

absolute  sense . 

VII   Constructing  the  Performance  Index 

In  order  to  examine  the  suitability  of  several  common  performance 
indices  for  obtaining  the  objective  stated  above,  their  values,  corre- 
sponding to  step  responses  with  forward  gain  set  at  K,  are  plotted 
versus  K.  The  minima  of  ISE  and  ITAE,  et  al,  are  seen  by  inspection 
not  to  coincide  with  the  optimum  K  for  minimum  response  time  in  the 
absolute  sense .  That  ISE  does  not  provide  the  IP  we  seek  is  not  sur- 
prising s  in  view  of  Gibson's  observations .  One  would  expect  ITAE  to 
improve  on  ISE,  since  time  has  been  added  as  a  penalty  factor;  and  it 
does,  to  some  extent .  It  is  apparent,  however,  that  functions  of 
time  and  error  alone  will  not  suffice  as  consistent  selectors  of  optimum 
parameter  settings . 

Careful  inspection  of  Figure  2  suggests  that  we  should  be  concerned 
not  only  with  functions  of  x.  (error)  as  indices  but  with  functions 
containing  x„  (velocity)  as  well,  in  such  a  way  that  the  magnitude  of 
vector  D  is  indicated.  An  index s  or  cost  function9  that  penalizes 
duration  of  D  would  intuitively  seem  to  hasten  the  entry  of  the  state 
point  into  the  target  circle.  Toward  this  end,  the  following  index  is 
suggested^ 

o        n 
where  the  velocity  state  has  again  been  normalized  by  the  system's  natural 
frequency.  Integral  tables  are  used  to  evaluate  IP  as  follows g 


R2 


2aK      +  K  L  2a  J 


IP  «  — ^ +  £  I  Sr 

2 
Note  that  60  =K,  from  the  characteristic  equation  of  the  system, 
n 

s2  +  Kas  +  K  =  0  (15) 

Substituting  a  =  —  from  equation  (6)  into  equation  (14),  we  have 


■•[•♦fc] 


K2 


For  minimum  IP, 


4K 
from  which 


£&&  =  ^  [3K4  -  2K(BE  +  K3)  ]  -  0  (17) 


K  =  (16E)1/3  (18) 


This  yields  a  damping  ratio  of 

,3/2 


c  3   2     ■  hr   =  lo°  (19) 

We  note  that  the  optimum  damping  ratio  of  unity  is  independent  of 
y   or  R.  In  the  case  for  which  Figure  3  was  drawn,  y  -   R  ■  1»0,  giving 
an  optimum  gain  K,  by  equation  (18),  of  2»52°  This  result  compares 
very  well  with  the  calculated  responses  as  presented  in  Figure  3°  An 
index  of  performance  has  been  found  whose  minimum  coincides  with  that 
of  another  performance  characteristic;  namely,  minimum  response  time 
in  the  absolute  sense,  in  the  presence  of  an  energy  constraint <> 
VIII   Another  Example 

Let  us  now  apply  the  IP  of  equation  (13)  and  the  constraint  of 
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equation  (4)  to  another  second-order  .system9  that  of  Figure  4,  in 
which  the  plant  has  a  i$on-zero  pole„  For  step  inputs  0^  ■  Ru(t), 
integral  tables  yield 


R2K  [k+   P2] 


J  /*  "    2(, +  55     =  y  <20> 


The  IP  of  equation  (13)   is 


lp  .  R^  ±  R2(P  4-  Ka)2  1  TrV 1      (m 

1F  2K(p  4-  Ka)  +  K  l_2K<p  +  Ka)J      ^l) 

This  reduces  to 

» =  a\vfra Ka)2  <22> 

Equation  20  is  then  solved  for  (p  +  Ka) ,  the  result  being  used  to 
eliminate  a  from  equation  (22) »  The  IP  then  becomes 

U  .  f!  <^2  t  K3  +  2K2P2  t  Kp\  £  .  Z_  (23) 

*E      (K2  +  Kp2)  E2 

Differentiation  for  minimization  yields  the  fourth-degree  polynomial  in 
K, 

K4  +  2p2K3  +  pV  -  E2(16K  +  8p2)  =  0     (24) 

Unfortunately,  a  direct  literal  expression  for  K  in  terms  of  E  and  p  is 
not  obtainable.  The  equation  may  be  solved  for  given  values  of  p  and  E, 
however,  and  the  results  presented  graphically,  as  they  are  in  Figure  5, 

We  have  yet  to  show,  for  this  example,  that  the  index  of  performance 
minimizes  at  a  value  of  R  such  that  the  resulting  system  is  optimum  or 
near  optimum  with  respect  to  response  time.  To  show  this,  we  must  test 
for  the  damping  ratio  associated  with  each  solution  of  equation 
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Solving  for  C  from  the  characteristic  equation,  we  have 

C  =  Pf  Ka  (25) 

2  Vk~ 

where  K  is  obtained  from  (24)  and  a  from  (20) .  We  may  generalize  the 
results  of  the  previous  example  to  state  that  the  time-optimal  re- 
sponse is  characterized  by  a  C  °f  1°0  f°r  these  second-order  systems. 
The  contours  of  constant  £  superimposed  on  Figure  5  give  an  indication 
of  how  near  or  far  the  index  used  comes  to  selecting  a  time-optimal 
design. 

Figure  5  reveals  that  the  IP  of  equation  (13)  is  not  a  consistent 
selector  of  optimum  parameters;  i.e.,  the  damping  ratio  £  of  the  se- 
lected system  is  dependent  upon  the  pole  position  of  the  plant,  and 
upon  the  total  control  effort  allowed  for  the  response  to  a  step  in- 
put. This  shortcoming  may  be  overcome,  however,  by  taking  advantage 
of  the  inherent  flexibility  of  a  multi-term  index  of  performance.  We 
notice  that  the  velocity  term  is  normalized  by  the  natural  frequency, 
CO  ,  but  no  further  weighting  has  yet  been  indicated.  A  weighting 
factor  /?  is  now  introduced  such  that 

o         n 
It  is  postulated  that  for  any  p  and  R  in  the  problem  of  Figure  4, 
there  exists  a  jS  such  that  the  IP  of  equation  (26),  subject  to  the 
constraint  of  equation  (20) ,  selects  parameters  K  and  a  to  yield  a 

damping  ratio  of  unity.  Minimization  of  equation  (26)  subject  to 
(20)  gives 
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K^R*  p2l  -  4E  [2K+  p2l 

j8  -    L        r L2n       J  (27) 

4EZ  |_2K  +  p^J 

where  K  is  determined  by  the  simultaneous  solution  of  the  constraint 
equation  (20)  and  the  damping  equation  (25)  with  C  -  1»0«  The  sol- 
utions of  equation  (27)  are  presented  in  Figure  6» 

Figure  6  constitutes,  in  graphical  form.,  an  algorithm  for  the 
selection  of  the  first  weighting  factor  in  the  general  IP  of  equation 
(12),  as  it  applies  to  the  minimization  of  response  time  in  the  system 
of  Figure  4.  It  is  seen  that  the  weighting  factor  0  will  lie  between 
*■  l.Oo  It  may  be  shown  that  the  IP  itself  remains  positive ,  and  that 
the  effect  of  the  j3  factor  is  one  of  shifting  the  minimum  of  the  IP 
to  coincide  with  a  desired  optimum  design . 
IX   A  Third-Order  Case 

It  is  possible,  of  course ,  to  claim  that  the  design  problems  of 
the  preceeding  examples  could  have  been  carried  out  without  the  use 
of  the  performance  index.  For  example,  the  constraint  equation  (20) 
and  the  damping  ratio  equation  (25)  with  £  =  1  can  be  solved  simul- 
taneously to  give  a  unique  solution  that  is  time  optimal »  For 
higher-order  systems,  however,  the  significance  of  £  and  its  re- 
lationship to  response  time  effectively  vanish,  leaving  us  without 
sufficient  equations  to  solve  the  optimization  problem-  It  is  in 
the  realm  of  higher-order  systems  8  then,  that  analytical  design  by 
cost  functions  of  the  form  of  equation  (10)  holds  some  promise „ 

Consider,  for  example,  the  system  of  Figure  7-  The  values  of 
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K  and  a  are  to  be  selected  to  minimize  response  time,  subject  to  the 
constraint  on  total  control  effort, 

J"  »2«  -  *\%:  t  ff  ■  r  as) 

For  y/R2  ■   10  and  p  -  1, 

a  =  Lfc-|2  (29) 

20-K 

The  following  IF  is  suggested t 

O  R 

The  selection  of  the  normalizing  factors  follows  the  rationale  that 

higher  loop  gain  will  give  rise  to  greater  magnitudes  in  the  derivative 

states .  Note  that  no  attempt  has  been  made  to  otherwise  weight  the 

factors  in  the  IP.  Evaluation  of  equation  (30)  yields 

R2  I  3  -  Ka  +  Ka2p I 

IP= f m (31) 

2K  |_a  -  lj 

The  index  may  either  be  minimized  analytically 3  as  has  been  done  in 
the  previous  examples,  or  equations  (31)  and  (29)  may  be  solved  as  K 
is  allowed  to  vary  over  a  region  within  which  the  minimum  value  of  IF 
lieSo  In  either  case,  the  labor  involved  is  considerably  less  than 
that  entailed  in  the  design  by  repeated  solution  for  the  response  of 
the  system* 

Figure  8  shows  the  time-to-target-sphere*  and  IP  information  for 

x,»      x„» 

*  The  target  sphere  is  measured  on  x, ,  — ,  and  — r  coordinates „ 

1  K      R2 


the  problem  of  Figure  7.   ITAE  is  also  included  for 'comparison.  Note 
that  the  IP  of  equation  (30)  does  fairly  well  in  locating  its  minimum 
near  the  time-optimal  system .   It  is  entirely  plausible  that  the  weight' 
ing  factor  argument  of  the  previous  example  could  be  extended  to  this 
problem,  although  this  has  not  been  done. 
X   Conclusions 

It  has  been  shown  that  multi-term  indices  of  performance  offer, 
through  proper  weighting  of  their  several  terms,  a  means  of  selecting 
system  parameters  to  optimize  a  linear  system  with  respect  to  response 
time.   It  is  conceivable  that  performance  characteristics  other  than 
response  time  may  be  optimized  in  like  manner.  No  direct  and  general 
process  for  the  selection  of  a  weighting  scheme  has  yet  emerged  from 
the  studies  made  to  date.  Further  investigation  is  being  carried  on 
into  weighting  schemes,  constrained  and  unconstrained  systems,  trans- 
lation of  time  and  frequency  domain  specifications  into  properly 
selective  performance  indices,  and  other  topics  related  to  the  direct 
analytic  design  of  control  systems. 
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